Opportunities for Crowdsourcing Research on Amazon Mechanical Turk
نویسندگان
چکیده
Many crowdsourcing studies have been conducted that utilize Amazon Mechanical Turk, a crowdsourcing marketplace platform. The Amazon Mechanical Turk team proposes that comprehensive studies in the areas of HIT design, workflow and reviewing methodologies, and compensation strategies will benefit the crowdsourcing field by establishing a standard library of repeatable patterns and protocols. Author
منابع مشابه
Nonnaïveté among Amazon Mechanical Turk workers: consequences and solutions for behavioral researchers.
Crowdsourcing services--particularly Amazon Mechanical Turk--have made it easy for behavioral scientists to recruit research participants. However, researchers have overlooked crucial differences between crowdsourcing and traditional recruitment methods that provide unique opportunities and challenges. We show that crowdsourced workers are likely to participate across multiple related experimen...
متن کاملEvaluating Crowdsourcing through Amazon Mechanical Turk as a Technique for Conducting Music Perception Experiments
Online crowdsourcing marketplaces, such as the Amazon Mechanical Turk, provide an environment for cost-effective crowdsourcing on a massive scale, leveraging human intelligence, expertise, and judgment. While the Mechanical Turk is typically used by businesses to clean data, categorize items, and moderate content, the scientific community, too, has begun experimenting with it to conduct academi...
متن کاملThe cultural work of microwork
This paper focuses on Amazon Mechanical Turk as an emblematic case of microwork crowdsourcing. New media studies research on crowdsourcing has focused on questions of fair treatment of workers, creativity of microlabor, and the ethics of microwork. This paper argues that the divisions of labors and mediations of software interfaces made possible by sociotechnical systems of microwork also do cu...
متن کاملAmazon Mechanical Turk: A Research Tool for Organizations and Information Systems Scholars
Amazon Mechanical Turk (AMT), a system for crowdsourcing work, has been used in many academic fields to support research and could be similarly useful for information systems research. This paper briefly describes the functioning of the AMT system and presents a simple typology of research data collected using AMT. For each kind of data, it discusses potential threats to reliability and validit...
متن کاملIs there a Doctor in the Crowd? Diagnosis Needed! (for less than $5)
We investigate the feasibility of crowd-based medical diagnosis by posting medical cases on a variety of crowdsourcing platforms: general and specialized volunteer question answering sites, and pay-based Mechanical Turk (MTurk) and oDesk. To assess the crowd’s ability to diagnose cases of varying difficulty, three sets of medical cases are considered. While volunteer channels proved ineffective...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2011